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ABSTRACT 

A study was conducted at Saddleback College to 
evaluate the retention, achievement, and satisfaction of students 
enrolled in the college's telecourse program. The study sample 
included all telecourse and en-campus students enrolled in courses in 
American government, human 'behavior , music, and marine biology in 
spring 1983. Study methods, which included student surveys and pre- 
and post-testing of subject mastery, focused on developing 
comparative profiles of students who finished the telecourses and 
those who did not; comparing the achievement of telecourse and 
on-campus students; and assessing the satisfaction of telecourse 
completers. Study findings included the following: (1) there were no 
differences between telecourse completers and non-completers in 21 of 
26 questionnaire items regarding personal and academic 
characteristics (e.g., sex, age, marital status, ethnicity, college 
and high school grades, and occupational status) ; (2) in comparison 
to non-completers, completers more frequently preferred to study 
alone, were taking the course for degree requirements or career 
advancement, and had previously taken telecourses; and less often had 
problems taking courses on campus; (3) there was no significant 
difference in the post-test scores of the telecourse and oi-campus 
students for any course; and (4) telecourse completers expressed 
overall satisfaction with their experience. Questionnaires are 
appended. ( LAL) 
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EVALUATION OF THE TELECOURSE PROGRAM 
AT SADDLEBACK COLLEGE 
STUDENT RETENTION AND ACADEMIC ACHIEVEMENT 

By 

Jeanne Smith c 
August, 1983 

This studv evaluated three aspects of the telecourse program 
at Saddleback College during the Spring 1983 semester: (1) student 
retention, (2X student achievement, and (3) student satisfaction 
with the telecourse program. 

The sample included all telecourse and on-campus students 
enrolled in: (1) Political Science 1 --American Government, (2) 
Psychology 33--Understanding Human Behavior, (3) Music 20--Topic 
Music, and (4) Marine Science 175--Oceanus. ^ 

A questionnaire developed to determine the profile of each 
telecourse enrollee, was given to all telecourse enrollees at the 
Spring 1983 semester orientation meeting. Arrangements were 
made to allow any student who could not attend the ^orientation to 
complete the questionnaire any time during the first two weeks of 
the semester. One hundred ninety-eight questionnaires were 
completed. 

The returned questionnaires were separated at the end of the 
semester , by finishers and non-f lashers. In order to evaluate 
student achievement, a test for each course was developed to be 



given as a pre- and post-test. This test was developed by the 
course instructor in collaboration with the author. In each course, 
the same instructor taught both the telecourse and the parallel 
on-campus course. Outlines of each telecourse and its parallel 
on-campus course were inspected to insure that they were identical. 

The quasi-experimental method was used^tcTtesT^the hypothesis: 
"There is no significant difference between the post-test scores of 

the telecourse students and the parallel on-campus students. JJ -This. 

hypothesis was tested using an analysis of covariance at a 0.05 
level of significance. 

A second' questionnaire was developed to assess the satisfaction 
with the telecourse program as perceived by those students who 
finished. This questionnaire was given to all telecourse students 
with the final examination. Each answer was given a weighted 
value, and the mean score for each statement was computed. 

The major findings of this study include: 

Student Retention . Students over thirty-three years of age 
who had taken ever thirty college units have a higher rate of 
completion than other students. Students who completed -&je_ 
courses were more likely to be taking the course for degree re- 
quirements and were more likely to have declared a major than 
those who failed to complete the courses. The most dramatic 
finding was that fifty-eight percent of those who had completed ..a 
questionnaire finished the course in which they were enrolled, but 
only six percent of those who did not complete the questionnaire 
finished the course in which they were enrolled. 



Student Achievement . The analysis of coyariance indicated 
that there was no difference in the amount of learning that took 
place in the telecourses compared to the parallel on-campus courses. 

Student Satisfaction , Students were generally satisfied with 
the telecourse they had taken. 

Assessment of the telecourse program at Saddleback College 
led to the conclusion that students are satisfied with the program 
and are learning as much as on-campus students. Younger students 
with little experience at taking college courses, should be advised 
to take on-campus courses instead of telecourses. An extremely 
low percentage of students who failed to complete the preliminary 
questionnaire, primarily because they declined to attend the volun- 
tary orientation meeting, completed the class in which they enrolled. 
While they are not for everyone, telecourses should continue to be 
offered as an alternative mode of instruction. 
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CHAPTER I 
THE PROBLEM 
Introduction 



Perhaps the most important challenge of the community college 
Is to promote the maximum development cf each student's capabilities. 
To meet this challenge alternate methods of instruction must be 
devised (Whisnant/ 1978). Students learn in a variety of ways 
and no particular teaching method will meet every student's needs 
(Roueche, 1853). Consequently/ many community colleges have 
shifted away from using the traditional lecture method as the only 
approach to teaching.- "Underlying the efforts to succeed at each 
curricular area was a veiled motto: Innovate/ innovate/ innovate-- 
change is progress" (Whisnant/ 1978:2). "Major pressures for 
changs come from npntraditional groups of students new to higher 
education: those over 25 (who already outnumber students under 
25), women with families/ minority students/ and students from 
nonacademic backgrounds" (Richardson/ 1981:2). One of the 
results of this pressure to change has been the increase in the 
use of television as. an alternate means of instruction. It provides 
opportunities for students unable to attend oh -campus courses due 
Uo the constraints of job/ family/ illness, disability/ or geographic 
distance. 
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While much of the community college's success can be attributed 
to this spirit of innovation, Suzanne de Lesseps (1976) noted that 
the public tends to blame? innovative teaching for the decline in 
students 1 basic skills. She also asserted that the public equates a 
return to basics with a decrease in innovative teaching. The days 
of Innovation for innovation's sake are gone. "Creative change 
must be more calculated and deliberate than ever before, and a 
thread of tradition must be maintained to balance innovation" 
Whisnant, 1978:3). Thus, whenever a new method of instruction 
is used, it is important to compare the students' success to that 
achieved in a similar situation under traditional lecture formats. 

Such analyses have been conducted continuously since the 
origin of telecourses, and telecourses have generally been found to 
be very competitive with conventional classroom instruction. When 
the first results of these analyses became known, some telecourse 
educators voiced euphoric projections such as "In the opinion of 
some college educators experimenting with programmed and automated 
instruction, the classroom will be obsolete as- a locus of instruction 
within the next fifteen years" (Hoban, 1963:97). Fifteen years 
have, of course, elapsed since that was written, and the prediction 
has not come to pass. The reason can easily be found in the 
records of the continuing comparisons between telecourses and 
traditional courses: "A common report among experimenters is that 
they f;nd more variance within than between media— meaning that 
learning seems to be affected more by what is delivered than by 
the delivery system" (Schramm, 1977:273). In father words, good 
telecourses are excellent teaching vehicles; poor telecourses are 



inferior to the normal classroom environment* Consequently, 
every Institution offering a continuing program of telecourses has 
a responsibility to analytically evaluate its program periodically to 
determine its effectiveness (Schramm, 1977). 

Although telecourses generally compare favorably to traditional 
courses with respect to student achievement, the comparison Is 
distinctly unfavorable with respect to student retention (Munshi, 
1980)* She found telecourse attrition rates snuch higher than 
overall campus attrition rates nationwide, and particularly in 
California. Smith (1982) found telecourse attrition rates at seven 
California community colleges approximately double campus averages. 
Because of these high attrition rates, an instrument needs to be 
developed to pinpoint high risk, telecourse students. The very 
nature of telecourseis allows for little teacher-student interaction, 
and even less student-student interaction ♦ Students who peed this 
type of Interaction may have difficulty with' telecchjrses./^Wule 

6'; 

studies have been done to determine the profile of the sU 
who finish, no studies have been done to compare that p[roflleJ» 
the profile of those students who fail to finish. 

Statement of the Problein> 

' . /' 7 - 

Almost from their inception, telecourses have been plagued 
with two problems, one real and one perceived- The first problem 
is the high attrition rate which can reach twice that of on-Campus 
courses (Munshi, 1980). The second problem is that telecourses, 
despite academic studies indicating the contrary, are perceived by 

■ -r-i.* » 

some as "easy," with the view that less is required of the students 
both quantitatively and qualitatively CWolfgang_and Dowling, 1981). 



These problems have been discussed at some length by the 
faculty of Saddleback College. At Saddleback College the tele- 
course attrition rate Is almost twice that of on-campus courses 
(Smith, 1982). This has caused many faculty members to question 
the effectiveness of "telecourses. A study needs to be done to 
analyze factors, contributing to telecourse attrition and to develop a 
survey instrument for predicting the retention probabilities for 
individual students. This survey instrument could then be used 
to direct counseling to students shown to have a poor retention 
probability. 

Many faculty members at Saddleback College feel that tele- 
courses are hot comparable to parallel on-campus courses. They 
feel that the telecourse format cannot possibly be as good as 
on-campus instruction because telecourse students spend only 
one-third as much time viewing a course as they would spend 
attending an on-campus course. Many studies have compared 
telecourses to parallel on-campus courses, but neither method has 
been shown to be generally superior to the other (Schramm, 1977). 
That is, a well-designed and implemented telecourse can be better 
than traditional classroom instruction. Unfortunately, a poorly 
designed and implemented telecourse is usually worse. 

It is for these reasons that a study of retention and achieve- 
ment of telecourse students at Saddleback College is necessary to 
evaluate the current telecourse program and to provide guidance 
for future improvement. , 

f 

i 

i 

f 
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Background and Significance 

Television courses have been used as a method of instruction 
in higher education since the 1950's. The first courses were done 
live with instructors lecturing In front of a camera. These courses 
were not especially successful because television is not the proper 
medium for lectur (Shulman, 1981). Today, the television presen- 
tations are much more, elaborate: telecourse crews travel all over 
the world to gather footage for courses. In addition, modern 
telecourses ar€ more than television shows. They also include 

texts and study guides to supplement the video presentation 

* . 

(Shulman, 1981). Most courses now include quizzes to aid the 
student in studying for examinations (Jelen, 1977). 

Telecourses generally fall into one of two categories. Many 
telecourses are especially produced for education with accompanying 
printed material. However, many other telecourses, called "wrap- 
around" courses employ shows produced for the general television 
audience with special printed study material written around the 
program. Students may view these shows during their regular 
showing, and receive credit by completing the study materials 
(Munshi, 1980). Examples of shows that were also wrap-around 
telecourses include "The Adams Chronicles" and "The Ascent of 
Man" series shown on commerical television, and the "Masterpiece 
Theater" series shown by the Public Broadcasting System. 

Colleges tend to resist telecourses for two principal reasons: 
(1) lack of respect for such instructional methods, and (2) lack of 
support from the faculty (HershfieW, 1980). Surveys -taken in 
1979 asked colleges whether or not their faculties were supportive 
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of telecourses. Forty percent of the colleges responded that a lack 
% of • faculty support prevented the use of telecourses (Dirr and 
Redone, 1979)- A study done by Dirr and Katz (1981) found that 
one of the major barriers to the use of television for instruction at 
some colleges was the lack of faculty support. Hershfield (1980) 
also found faculty unwilling to try telecourses. He concluded that 
most faculty regarded television as second-class compared to on- 
campus instruction. 

According to Brock (1980)/ there were over 100 new telecourses 
produced and marketed nationwide by 1979, and almost one-half 
million people were enrolled in telecourses in that year. This 
growing interest in the use of television by colleges Is due to 
several other factors affecting education ♦ These factors include 
the increasing median age of Americans, the energy crisis, and the 
wide acceptance of television as an entertainment medium. 

The United States has become an aging society. Today the 
median age is 30 years and by the year 2030 approximately twenty 
percent of the population will be 65 or older. As the percentage 
ever 65 increases, the percentage consisting of 18-25 year olds 
that have traditionally dominated student populations will decline 
(London and Ewing, 1980). More of these older students are 
women and part-time students, who demand more time flexibility 
than their younger full-time students counterparts. Many of these 5 
students have found night course selection limited, and are trying 
telecourses as an alternative (Mondale, 1977). 

Another factor that has impacted the college curriculum is the 
energy crisis. It has increased the cost of transportation, thus, 
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telecourses appeal to many who must commute long distances to 
school (Brock, 1980). 

According to Helmantoler (1978)/ the average working adult 
enjoys fifty hours of leisure time a week. Twenty-two hours of 
this leisure time is spent watching television. Over ninety-seven 
percent of all U.S. homes now have at least one television set. 
Helmantoler felt that these facts, combined with the evidence of 

learning success through television/ show great potential for 

■ f 

colleges. 

In a time of declining enrollment/ colleges are attempting to 
develop alternate delivery systems to counter this trend (De 
Chenne, 1980). Faculty are being oriented and conditioned to use 
television as a means of teaching; end administrators are being 
trained to manage telecourses successfully (Mc Ceilan^ 1980). 

Major Issues and Research Questions 

The principal issue In this study was an evaluation of the 
teiecourse program at Saddleback College. This study involved 
two aspects of student performance: student retention and student 
academic achievement. 

The high attrition rate among students enrolled in telecourses 
is a problem nationwide and particularly In California (Munshi , 
1980). Saddleback College is no exception. Last year, almost sixty 
percent of the students who enrolled in telecourses failed to complete 
these courses (Smith, 1982). Despite this, as far as can be 
determined, no studies have been done either at Saddleback 
College or at any other institution -to determine -the profile of the 
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students who fail to finish. This study attempted to answer the 
following question: 

„ What is the profile of the telecourse students who 
^ finish compared to those who fall to finish? 

Telecourses have proliferated since the 1950's. Recently 
former ambassador Walter Annenberg gave $150 million dollars to 
the Corporation for Public Broadcasting to create new telecourses 
(Richardson, 1981). As a result of this growing interest in the 
use of television as an alternate method of instruction, college 

r 

i . 
membership in telecourse consortia has increased (Richardson, 

|i ■ • * 

1981). Most of these consortia not only offer telecourses but 
produce and market them as well- Therefore, the number of 
telecourse producers is also increasing. Because there is no 
central agency to evaluate and approve telecourses, this burden 
falls on the users. Consequently, colleges using these telecourses 
should periodically evaluate them to determine their effectiveness 
on the local student population. 

While Saddleback College has offered telecourses every semester 
since 1974, they have nevar been evaluated to determine their 
effectiveness on the population they serve. Many of these courses 
have parallel on-campus courses, frequently taught by the same 
instructor. Thus, comparisons of learning feveSs between the two 
types of courses can be made with relatively good validity. This 
comparison is particularly important at Saddleback College because 
the majority of the telecourses are transferable to four-year uni- 
versities and. have been approved by -the faculty as equivalent to 
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the paralltfC? on-campus courses. This study tested the following 
hypothesis: 

There Is no significant difference between the post- 
test scores of the tetecourse students and the parallel 
on-campus students. 

Purpose 

The purpose of this study was to evaluate the telecourse 
program at Saddleback College. Three aspects were addressed: 

1. Student Retention . This study compared the profile of the 

• \ • 

students who finished telecourses to the profile of those students 

who did not. 

2. Student Achievement . Student achievement was compared 
between telecourses and parallel on-campus courses. 

3. Student Satisfaction . Satisfaction of the telecourse program 
as perceived by those students who finished was assessed. 

Limitations and Assumptions of the Study 

It was assumed that the outlines for each telecourse and Its 
parallel on-campus course were the same. 

It was assumed that there were enough responses on the 
questionnaire to differentiate telecourse finishers from non-finishers. 
It was also assumed that telecourse students answered the questions 
honestly even though their names were on the questionnaire. 

Because students were not informed that the pre-test would 
be given as the final exam/ it was assumed that pretesting at the 
beginning of the semester would not produce a Hawthorne effect on 
the^students. While the same test was used as both a pre- and 



10 

post^test, it was assumed that any practice effect making students 
more proficient on the post-test would be the same for both groups, 
it was also assumed that the locally prepared tests would provide a 
valid measure of student achievement. It was further assumed that 
variations in instructor ability were effectively removed by evaluat- n 
Ing only pairs of courses (one telecourse and one parallel on-campus 
course) taught by the same instructor. 

This study was limited to only those student enrolled in tele- 
courses at Saddleback College in the Spring 1S83 semester. It was 
assumed that this groUp of approximately 180 students would be 
typical telecourse enrollees. 
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CHAPTER II 

J 

REVIEW OF THE LITERATURE 

Achievement in Telecourses 

As our society changes, needs change. Today— the average- 
person changes careers at least twice during a lifetime. Women, 
even with children, are pursuing careers outside the home. 
Students in postsecondary institutions are older than a decade 
aco, and more likely to go to school part-time (Carmichael, 1981). 

Also true is the fact that traditional patterns of college atten- 
dance-are not always appropriate for adults in a society that 
provides^information freely to its inhabitants from many 
different sources but; at the same time; requires an increasing 
amount of certification for the acquisition of knowledge to be 
recognized (Munshi, 1980:1). 

One of the social responses to these facts has been the growth of 
telecourses. ' 

Colleges and universities have used television as a mode of 
instruction since the 1950's. Many of these early television courses 
failed due to (1) programs shown at times inconvenient for the 
student, (2) a lack of courses for credit, and (3) poor choices of 
locale: telecourses must draw from a heavily populated region in 
order to net a sufficiently large student audience (Shulman, 1981). 
However, these early problems have generally been overcome, and 
today telecourses are shown weekly in a large number of metro- 
politan areas to half a million students across the country. 
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Researchers have studied the effectiveness of telecourses 
since their inception. Literally hundreds of studies comparing the 
results of telecourses to parallel traditional courses have been 
conducted. As a significant volume of the studies has become 
available, numerous authors have attempted to collect and summarize 
their results. Due to the wide diversity of the studies, a certain 
variance In results is unavoidable. Despite this study-to-study 
variation, the literature surveys have generally agreed on one 
basic conclusion: other factors being equal, telecourses are at 
least as good as traditional on-campus * lecture-format courses. 
The development of this conclusion is outlined in the following 

summary j>f relevant experimental studies and literature surveys. 

W 

Studies done Fh the 1950's and 1960*$ found that studenfs carv 
learn as well via television as In a conventional classroom (Luskin 
and Zigerell, 1978). In a study conducted at the University of 
Detroit, Bundy (1960) found that telecourse students learned 
Spanish verbs as well as on-campus students> 

The Chicago TV college started In 1956 with a grant from the 
Fund for Advancement of Education. This college began as a 
three year experiment of the Chicago City Junior College in offering 
college courses leading to the associate of arts degree. During 
the first three years, achievement comparisons were made between 
telecourse and parallel on-campus courses. In most cases no 
significant difference was found betweeen the two groups. In nine 
cases^there was a significant difference: seven favoring telecourses 
and -two favoring on-campus courses (Erickson and Chausow, 
1960). 
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Kumata (1960a) conducted an experiment with a course in 
basic advertising at the college level. This experiment was repeated 
the following semester. He compared achievement in a telecourse 
to that in a parallel on-campus course* In the first experiment 
trial, the on-campus class did significantly better than the tele* 
course. The second experiment trial, however, showed no signifi- 
cant difference between the two groups. 

In his review of research on instructional television, Kumata 
(1960b) found that in most cases there was no significant difference 
between telecourses and on-campus courses. However, his review 
concluded that TV students did hot do as well as on-campus students 
in the second semester of a year-long sequence where no difference 
had been found the first semester. 

Schramm (1962) reviewed one hundred studies comparing 
college level telecourses to equivalent on-campus courses. Eighty- 
four studies found no significant difference between the two methods 
of delivery. In three cases telecourses were significantly kiore 
effective and In thirteen cases they were significantly less effective 
than on-campus courses. Thirty-two studies compared telecourses 
to on-campus courses by subject matter. He found that in only 
one case (science) was the telecourse less effective. -The majority 
(21) of cases showed no significant difference. 

In a classic study published in 1963, Stickel I evaluated a 
large number of these studies against, a set of exacting experimental 
evaluation criteria. Of the two hundred fifty studies that he 
reviewed, he found only ten that satisfied his criteria. In all ten 
cases, no significant difference was found between telecourses and 

o 
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parallel on-campus courses. In twenty-three other studies that he 
found marginally acceptable because they contained minor design 
flaws, only three showed statistically significant differences—all in 
favor of the telecourses. 

In a later review , Chu and Schramm (1967) reviewed over tWo 
hundred studies comparing telecourses to on-campus courses In 
college leivel courses. Again, the majority (152) of the studies 
concluded no significant, differences. Twenty-two studies showed 
telecourses. to be more effective and twenty-eight showed them to 
be less effective than on-campus courses. 

Purdy (1978) came to the conclusion that research has found 
that telecourse students learn at least as well as on-campus stu- 
dents. Recently, individual telecourses have been compared to the 
same on-campus course by Agler (1976), Purdy and Icenogle 
(1976), and Dallas County Community College District (1977)- In 
all cases, researchers have come to the same conclusion: telecourse 
students have the same or a higher achievement rate than the 
on-campus students. 

In her study, Agler (1976) concluded that In English 101, 
telecourse students obtained significantly higher scores than did 
on-campus students on a required compostion scoring in three 
areas: (1) organization of the entire paper, (2) organization of 
individual paragraphs, and (3) overall quality of the paper. In 

X ' ■ 

the other scoring areas (spelling, mechanics, diction, usage, and 
sentences), nonsignificant differences were encountered between 
the two groups. Agler further noted that both groups improved 
significantly from the beginning to the end of the semester. 
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Mount and Walters (1980) compared the performance of students 
in a televised Introductory psychology course to that of students 
in a parallel on-campus course at Mountain View College (Texas). 
They found that the telecourse students achieved significantly 
higher test scores even when the scores were adjusted for age. 
They concluded: "These results are surprising, in that, students 
in the traditional method appeared to have the advantage of more 
lecture and review relevant to the test questions" (Mount and 
Walters, 1980: 49-50). 

Hult (1980) conducted a study to compare the effectiveness of 

telecourses to on-campus coufees and to examine the effect of 

instructor visits to TV courses. The study involved ninety-six 

graduate students enrolled in a basic course in human development 

at the * University of South Carolina. The subjects were divided 

into three classes: (1) TV without Instructor contact, (2) TV with 

instructor contact, and (3) regular on-campus class. Results 

indicated that learning did not differ significantly^between the 

three modes of instruction. The author concluded: 

This finding seems particularly supportive of the claim that 
TV is an effective medium for college and graduate level 
instruction since in this study comparisons of TV and non-TV 
groups were based on tight control for such variables as 
instructor, course materials and course content, and examina- 
tions (Hult, 1980:7). 

Schramm (1977) summed up the research on the achievement 
in telecourses versus on-campus courses by saying: 

We conclude from the evidence that, overall, there is no 
basis in the research for saying that students learn more or 
less from television than from classroom teaching. This does 
not mean that under some conditions of teaching some students 
do not learn more of certain subject matter or skills from one 
medium or channel of teaching than from the other. But the 
results of the broad comparisons say that there is, in general, 
no significant difference (Schramm, 1977: 28), 



Attrition 

On-Campus Courses 

Student attrition has always been of concern to academic 
administrators because it indicated students dissatisfied with the 
courses in which they have registered. In recent years, however, 
a second Influence of attrition has attracted increasing attention: 
loss of revenue. Most colleges are dependent upon student fees or\ 
state appropriations on a per student basis. When student-attrition 
is high, colleges have a more difficult time meeting expenses 
(Summerskill, 1962). 

In 1976, California passed the Proposition 13 Property Tax 
* Initiative that has had the effect of reducing the tax support of all 
types of public schools. California community colleges have begun 
to feel the financial strain of revenue lost from the passage of 
Proposition 13, and high student attrition agravates this problem- 
For example, at American River College (California), student attri- 
tion for the academic year 1978-1979 cost the college over 2.5 
million dollars in state funds (Rasor, 1980). Total student body 
attrition exceeding thirty-three percent at Ohlcme College (Cali- 
fornia) not only resulted in lost income to the college, but also 
disrupted many programs being offered (Baker, 1980). A large 
state university calculated that the institution's forty-one percent 
attrition rate over five years cost the university an annual loss of 
tuition revenues approaching ten million dollars. Because that 
university could no longer afford such a loss of income, there 
existed an urgent need to study ways of preventing attrition 
(JacKley and Henderson, 1979). 



Colleges today are experiencing a decline in enrollments which 

has also increased concern about the causes 5 of and cures for 

student attrition • The Carnegie Commission (1980: 11) reporting 

on college enrollments stated: 

, Overall, the traditional college-bound group of eighteen to 
twenty-four year-olds will decline by twenty-three percent by 
i9S7. Using such projections, the Council concluded that 
enrollments will remain relatively constant until the Fall of 
1983 and then' decline through the Fall of 1988- They will 
remain relatively constant through the & Fall of 1990, and ther^ 
decline even more sharply from 1991 through 1997. Thus 
colleges in general have about three more full academic years 
to prepare themselves for the onslaught of the first slide. 

■c ■ — ... 

Jackley and Henderson (1979) suggested that less money 
could be spent on student recr itment if administrators spent more 
money on student rietention, v claimed that retaining students 

until graduation not only helped maintain the quality of instruc- 
tion but also saved institutional, state, and federal investments. 

As a result, a number of researchers have sought to determine 
why students drop classes. Thompson (1969) found that most 
students dropped only one class, and that age and 1 sex were not 
related^to withdrawal. He concluded that the major reasons for 
dropping were: (1) Job conflict, (2) lack of interest, (3) wrong 
program, (4) academic difficulty, and (5) conflict with the instruc- 
tor. In later studies, Baratta (1977) and Friedlander (1981) found 

e 

the situation little changed. They concluded that most students 
withdrew from classes for academic reasons, such as: (1) found 
the course too difficult, (2) got behirtd in work, (3) lost interest, 
or (4) had too many course units. "\ 

Broadbent (1975) studied student^ class attrition at Leeward 
Community College (Hawaii). The most frequent reasons students 
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gave for withdrawal were (1) schedule conflict/ (2) fear of a 
failing grade, (3) inadequate academic background, and (4) dis- 
satisfaction with instruction or course content. These conclusions 
were supported by a similar study at Roane State Community. 
College, Tennessee (1975). 

The Texas Education Agency (1977) studied withdrawals at 
ten Texas community colleges in the Fall 1S76. The most frequently 
given reasons for class withdrawals were (1) grade problems, (2) 
a heavy course load, (3) job conflict, and (4) dissatisfaction with 
instruction. In 1978 Daly and Bateman questioned each student 
who had dropped at least one class at Santa Ana College (Cali- 
fornia). While the most frequent single reason for dropping was 

i 

job conflict, the major reasons were related to the academic pro- 
gram. 

Hurrter and Sheldon (1979) studied California ' community 
colleges and found the major reason for withdrawing from a class 
was Job conflict. While this reason was one over which the college 
had no control, other reasons given by students for withdrawing 
from a class were Instruction-related. The instruction- related 
problems most cited Included: (1) fear of receiving a failing grade, 
(2) inadequate prerequisite Instruction, (3) dissatisfaction with 
course content, and (4) failure to keep up. These same reasons 
were also reported In studies conducted by Matley (1978) at Ventura 
College (California) and by Woods (1978) at Kalamazoo Valley 
Community College (Michigan). In all cases, students' decisions to 
withdraw from college classes were primarily Instruction -related. 
'•The finding that many students drop classes for Instructional- 



related reasons Indicates that educators are in a position to influence 
considerably the rate of attrition from classes at their institution" 
(Friediander, 1981:1). 

Studies have also compared causes of student withdrawal from 
college to the causes of withdrawal from classes. Rasor (1980) 
concluded that students who withdraw from college do so mainly 
for nonacademic reasons, while most of those who withdraw from a 
class do so because of academic difficulties. Daly and Bateman 
(1978) supported these conclusions by noting that most students 
left college for financial reasons and/or to take full-time employment. 
Only a small fraction of the students queried by Daly and Bateman 
listed academic reasons as the cause of their withdrawal from 
school. Daly and Bateman suggested that the greatest effort on the 
part of the college should be directed toward reducing class with- 
drawals, since most school withdrawals were for nonacademic reasons 
over which the college has no control. 

Li 

Wetzel (1977) found that the major reasons for students 
leaving Delaware County Community College were: (1) home or 
work obligations, and (2) financial problems. Students questioned 
were generally happy with college and expected to return at some 
future date. Bower (1977) reported these same conclusions in 
Boulder, Colorado. At Allegany Community College (Maryland), 
Anderson (1976) concluded that there were three major reasons 
that students left college: (1) financial, (2) entered Job market, 
and (3) achieved educational goal. The finding that nonacademic 
reasons— financial problems, job conflicts, and program 
completion— were the major factors in student withdrawal from 
college was also reported by Welch (I960). 
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Jackson and McMillian (1976) studied student attrition at 
Essex County College (New Jersey) and found that students left 
because of family problems/ disappointment with their program of 
study/ or financial problems. They concluded that/ in general/ 
the highest attrition rate occurred among younger students after 
their first year of college. 

California State University at Northridge developed an enroll- 
ment projection model. This model included all idergraduate 
students who entered during the Fall 1971 through Fall 1977. The 
study revealed "that fields with declining enrollments (e.g. Arts, 
Humanities) generally revealed the weakest persistence rates and 
fields with growing enrollments the strongest" (Newlon and Galther/ 
1980:245). Thus, the schools that can least afford student attrition 
are experiencing the most. Newlon and Galther hypothesized that 
students in certain schools (Business/ Engineering/ Mathematics) 
have a better chance of employment upon graduation and so have a 
higher persistence rate. 

Lightfield (1974) has added an optimistic note to the study of 
student withdrawal by observing that many students do come back. 
His results showed that most students will return at a later time to 
complete their educational goals. Bossen and Burnett (1970) 
reported that nearly half of all withdrawing students return to 
college at a later date. It should be noted also that many community 
college students have as their educational goal, the completion of 
only one of several classes and never intend to earn a degree. 
Thus, these students are psychologically not "drop-outs 11 because 
they do not leave school without completing their personal educa- 
tional goals. 

ERIC on 
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Teiecourses 

> 

Even though researchers have found that telecourse students 

do at least as well as on-campus students, they have also found a 
much higher attrition rate in the teiecourses. Agier (1976) re- 
ported significant differences in the withdrawal rate between the 
two English classes she examined. Fifty-two percent of the tele- 
course students withdrew in contrast to only thirty percent of the 
orjj- campus students. Duby and Giltrow (1978) concluded from 
their study that a typical college telecourse has a sixty percent 
withdrawal rate. Their figure included all students who received 
"no-credit" grades and incompletes as well as withdrawals. Munshi 
(1980) found, in general, student attrition in tejecourses was 
higher than in on-campus courses. The highest attrition rates 
were in California^. In California, students enroll in a large number 
of courses, then drop those in which they were less interested. 
Munshi attributed this phenomenon to the fact that the courses are 
free. Smith (1982) evaluated attrition at seven southern California 
community colleges and found telecourse attrition rates to be 
approximately double those of the total student body. 

Factors Associated with Attrition 

No studies have been done to date to determine a profile to 
predict student retention in telecourses, however, many such 
studies have been done on retention of students in college. Sum- 
merskill (1962) and Pantages and Creedon (1978) conducted large 
reviews of literature on college attrition and concluded that no 
single factor was the cause of attrition: factors contributing to 
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attrition and retention are complex and dependent upon the type of 
institution. In the following sections, a summary of the literature 
relating to the different factors found to significantly affect reten- 
tion is presented. Unless otherwise noted, the studies all represent 
retention in college rather than retention in a particular class. 

Demographic Factors 

Results concerning the ^ffect^of demographic factors such as 
age and sex on student attrition have been mixedi Sexton (1965) 
reported that, in general, students who enrolled at the median 
entrance age plus or minus one year had a slightly better chance 
of persisting than students who were two or more years off the 
median age of entering students. However, she discovered that 
age was only a weak factor in determining the probability of with- 
drawal. Summerskill (1962:631) concluded from his review of the 
literature that "age per se does not affect attrition although older 
undergraduates may encounter more obstacles to graduation. 11 On 
the other hand, Bledsoe (1953) found that among students who had 
postponed thoir education, the older were more persistent than the 
younger students. Saenger-Ceha (1970K also noted that while 
many studies showed that the persistence rate of younger students 
was higher, this was only true for students who went to college 
directly after high school graduation. Among the students who 
postponed their education, the older students were more persistent 
than the younger. A more recent study by Greer (1980) reported 
that at a junior college, age was directly related to persistence in 
developmental programs but inversely related to persistence in 
regular programs. 
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While sex is not a significant factor in all ^instances, it can be 
a significant factor for individual colleges and programs. Cope et 
ai. (1971) found that the type of institution (college, university, 
community college) affected the comparison between attrition rates 
among male students to that among female students. They found 
that the difference between the male and female attrition rates was 
significant at the four-year colleges they studied. Peng and 
Fetters (1978) concluded that significantly more women than men 
withdrew from two-year colleges. Contrary to the results of Cope 
et al. (1971), they found no significant difference at the four-year 
colleges they investigated. They suggested that the disagreement 
between their study and that of Cope et al. might be due to the 
type of institutions studied or might :"~ref lect—th£_ change in sex 
roles over the seven years separating the two studies. Bean 
(1980) studied student withdrawals in a freshmen composition 
program at a major midwestern university. He discovered that 
while both sexes had the same attrition rate, their reasons for 
withdrawing were different. He concluded that men left even when 
they were satisfied with the university, a phenomenon not found 
among women students . . 

A study by Astin (1978) illustrated specific examples of the 
manner in which the two sexes reacted differently to different 
types of institutions. He noted that (1) the highest withdrawal 
rates among men occurred at nonselective public universities, and 
the (2) the lowest withdrawal rates among women occurred at 
selective Protestant universities and at women's Colleges. He did 
net comment on withdrawal, of men students from women's colleges. 
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A study of high achievers by Astin (1964) concluded that 
women in that catagory were less likely to complete their academic 
program than were their contemporary men students. In another 
Institution-specific study, Johansson and Rossman (1973) found 
no effect of sex on attrition from a liberal arts college. 

Studies attempting to identify an effect of sex on nationwide 
average college attrition have had mixed results. A review of the 
literature by Tinto (1975) conflicted with reviews conducted by 
Summerskill (1962) and Pantages and Creedon (1978). Tinto 
concluded that women were generally more apt to withdraw from 
their college than were men. In contrast both Summerskill, and 
Pantages and Creedon concluded that while sex may be a contribut- 
ing factor at some colleges, it did not appear to be a significant 
factor in predicting attrition nationwide. 

Socioeconomic Factors 

SocioeconomicTfactors jsuch as family background and parental 
education have been extensively studied to determinejt^ir effect 
on the likelihood of students remaining in college. Peng^anTd 
Fetters (1978) found that family background was related significantly 
to attrition rates. They opined that this was probably due to 
parental expectations. Lenning et al. (1980:11) concluded that 
"the reason socioeconomic level relate? to student retention is 
because It affects pre-college environment and personality and 
they, in turn, affect student motivation and aspirations." Warriner 
et al. (1966) arrived at this same conclusion. They found that 
male college freshmen whose mothers and fathers had failed to 
complete their college education more often discontinued their 
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education than males whose parents had finished. In his study, 
Farhsworth (1959) concluded that if a student came from a family 
where educational and intellectual achievement was valued, the 
student was more likely to absorb these values and thus be more 
inclined to complete. This conclusion was confirmed in a more 
recent study conducted by Tinto (1975)- He concluded that students 
from lower status families have higher withdrawal rates than those 
from higher status families. An important aspect to this research 
was provided by Pantages and Creedon (1978) who concluded from 
their review of research, that socioeconomic factors were insignificant 
when the student's high school Grade Point Average (GPA) was 
controlled. From an analytical point of view, this finding has the 
powerful implication that experiments may be able to address the 
easily quantifiable high school GPA rather than elusive socio- 
economic factors. Further studies in this regard are required to 
validate this conclusion. 



Academic Factors 

Academic factors have been found to account for at least half 
the variance between finishers and non-finishers. High school 
^ GPA-hasJaeen found to be more significant than scholastic aptitude, 
although scholastic a close second in predicting 

attrition (Tinto, 1975; Marks ,_1967). ""~Tint^<TO^ 



because it corresponded more closely to the ^student's ability to* 



noted that high school GPA is a significant predictor of attrition. 
Astin (1973) concluded that the probability of getting a bachelor's 



the two, past grade performance tended 




achieve within an educational setting. Other researchers have also 
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degree in four years was increased by seventy percent if the 
student's high school GPA was at least a 3.5 (on a 4.0 scale). 
Demitroff (1974) asserted that academic factors are the most reliable 
predictors of attrition. Summerskill (1962) found that in ten out 
of eleven studies, the college dropout had lower average grades In 
high school than did the college graduate. He concluded that "it 
is possible substantially to reduce high attrition rates by simply 
raising college admissions requirements with respect to secondary 
school grades" (Summerskill, 1962: 634). 

Summerskill also reported that average scholastic aptitude 
scores were lower for dropouts than for graduates in sixteen out 
of nineteen studies that he reviewed. He concluded that colleges 
could "reduce attrition by rejecting applicants whose scores on 
standardized tests of scholastic aptitude fall beloW the minimums 
set by the college" (Summerskill, 1962: 635). The majority of 
studies that were reviewed by Pantages and Creedon (1978) con- 
curred that on scholastic aptitude, as measured by SAT and ACT 
tests, there was a significant difference between dropouts and 
non-dropouts. 

Since no one has devised an instrument that is totally accurate 
when predicting student retention/ many students enter college 
who will later drop Out. Summerskill (1962) found that first 
semester grades were a good predictor of attrition only if these 
grades were low. He further reported that high grades gave no 
indication of possible future withdrawal. Pedrini and Pedrini 
(l97^)^concluded_that, for predicting academic dropouts due to low 
grades, first semester^coTiege^gra^ the best predictors. 
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They found that, for black students at the University of Nebraska, 
college grades were the only significant predictor. In contrast for 
other students, ACT scores and financial aid receipt were also 
predictors. 

Studies have shown that while study habits are not a significant 
predictor, they do play a part in determining the likelihood of 
persistence. Demitroff (1974) concluded that dropouts more fre- 
quently characterize their study habits as poor or below average 
than those who remain. Sexton (1965) reported that those who 
remained estimated they spent more time studying per week than, 
they believed the average student did. 

0 

Motivation 

Many studies have been conducted to study motivational 
forces- -goals, interests, and satisfactions of the student as they 
relate to the college. Hackman and Dysinger (1970) found a 
relationship between academic competence and commitment to the 
college that affects persistence. Johnson and Chapman (1980) 
discovered that the best predictor of attrition was to ask students 
if they intended to return the. next semester. Forty percent of the 
students who saidNh^ey would not return did not return. A strong 
factor in student persistence is, the amount of involvement in 
academic and social activities (Astin, 1975). Bean (1980) also 
concluded that institutional commitment was an important variable 
in explaining student dropout.X In spite of the conclusions from 
these studies, Summers kill (1962: 639) concluded "The trouble here 
is that we do hot Know what motivational forces are actually pre- 
dictive of college success and we. do no\know how to accurately 
assess such motives, in students." 
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Pantages and Creadon (1978) in their review of twenty-five 
years of attrition research, also found no conclusion that could be 
drawn concerning motivational and personality factors as predictors 
of attrition. They claimed that research has been hampered by a 
lack of accurate assessment techniques. They further postulated 
that perhaps these factors may be far less important in determing 
whether or not a student will be a finisher than has been tra- 
ditionally assumed. 

Influence of Personal Contact on Attrition 

© 

On-Campus Courses 

In an effort to reduce class attrition at Mercer County Com- 
munity College (New Jersey), Grunes (1974) examined attrition in 
mathematics courses. He found that attrition was greatly reduced 
following the introduction of a student advisement program. This 
program consisted of placing students in mathematics classes based 
on ability and background information* 

Reed (1981) studied attrition at Kansas State University. He 
found three statistically significant predictors of student withdrawal: 
(1) student performance, (2) motivation, and (3) impression of the 
instructor. Students who were satisfied with their performance in 
a class tended to remain. As dissatisfaction increased, the pressure 
to withdraw also increased- Reed defined motivation in terms of 
class relevancy te> Che student. Students were more persistent if 
the class was interesting <and relevant to them. In' general, students 
who found the instructor interesting and helpful tended to continue. 
Reed concluded that a good relationship between counselor and 
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student could lower the likelihood of student withdrawal. He 
advised counselors to spend time with students trying to relieve 
anxieties they may have and to help students to identify their 
interests or special needs. He also suggested that instructors be 
make aware of the part they play in student withdrawal. Instructors 
should give students early positive feedback. Special efforts to be 
friendly and helpful will also tend to reduce student withdrawal. 
In conclusion, Reed felt the quality of interpersonal relationships 
of staff and students was a critical factor influencing students 1 
withdrawal decisions. 

< 

At American River College (California) Rasor (1980) sampled 
students during the Fall 1979 semester. He found five reasons for 
class drops: (1) difficulty of content, (2) job conflict, (3) subject 
-matter not as expected, (4) getting^ behind in course work, and 
(5) "instructor not interesting. This study strongly suggested that 
students drop classes mainly for academic reasons. Razor concluded 
that t\\e staff can have a high degree of influence over the rate of 
withdrawal from classes. < 

Napa College (Dallas, 1971) participated in a twenty-two 

college study (NORCAL) of attrition throughout northern California. 

i 

The second phase of this study involved developing a questionnaire 
to predict those students who had a high withdrawal potential. In 5 
the third phase, techniques were developed to increase the reten- 
tion of those found from the questionnaire to be attrition-prone. 
At Napa College a sample of these attrition-prone students were 
encouraged to seek the advice and help of a counselor. A signifi- 
cahtly larger proportion of these students remained the following 
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semester compared to a similar sample of students who did not 
receive counseling. -At Napa College the students who were 
attrition-prone lacked: (1) personal goals, (2) parental encourage- 
ment/ and (3) a feeling that college is important. The counselors 
asked the students to drop in for counseling and created a caring 
atmosphere. As °a result, on the average, students saw their 
counselor 3.5 times averaging fifteen minutes to an hour per visit. 
Dallas is careful to point out that these students received only 
counseling--no special tutoring. She posed the question "Ss failure 
due not to ability, but to no one caring?" (Dallas, 1971: 32). 

Sierra College (Beal and Noel/ 1980) also participated in JAje 
NORCAL project. They sent letters to a sample of attrition-prone 
students. Counselors also conducted one to eight interviews with 
each of these students. Again the retention and achievement was 
significantly higher than in the control group. 

Flannery- (1973) also found that personal contacts significantly 
lowered attrition. He concluded that the more contact students 
had with faculty members and staff the more likely they were to be 
satisfied with their education and to remain in college. Beal and 
Noel (1980) also contended that a positive effect upon attrition is 
created by a caring attitude of faculty and staff. Pascarena et al. 
(1978) found that students allowed to interact with the faculty 
performed substantially better than students who were not allowed 
to interact with the faculty. They also reported that past a certain 
threshold of interaction, further interaction provided little improve- 
ment in performance. This^, study has significant Implications for 
telecourse organizers. In tefocourses, the only viable choices are 
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"no Interaction" and "limited interaction." Massive interaction In 
telecourses is precluded by their very nature. However, this 
study suggests that massive interaction is only marginally more 
effective than the limited interaction option possible with telecourses. 

Telecourses 

The literature showed that attrition in both on-campus courses 

and telecourses was lowered when students and instructors interact. 

Personal contact was particularly important in telecourses. Duby 

and Giltrow (1978) found that many students required attention 

and encouragement toward the end of the course and at exam 

times. Studies showed that telecourse students liked meeting with 

the instructor at the beginning of the course (Helmantoler, 1978). 

When counseling \s made available as early in the course as 
possible, we would hope that the sense of anonymity inherent 
in mass education techniques can be counterbalanced with 
human concern for the individual (Duby and Giltrow f 1978:47). 

Purdy (1978) did a study at Coastline Community College 
(California) that showed feedback helped telecourse retention rates 
and course grades. Students who received an analysis of their 
errors on quizzes Had better end-of-course ^grades than those 
students who did not. Another study at Coastline found that 
students who received a postcard early in the semester asking 
their opinion of the telecourse were more likely to complete the 
course than students who. were not sent postcards. Purdy opined 
that the postcards constituted personal contact which encouraged 
the students to remain. 

Erickson and Chausow (1960) reported that telecourse retention 
at Chicago TV College was improved by increasing -the communication 
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between teacher and students. The retention level in Fundamentals 
of Mathematics 101 Improved from 26% in Fall 1957 to 59% in Fall 
1959. This was accomplished by having lesson-by-lesson mailing 
and return of assignments, face-to-face conferences, and scheduled 
telephone conference hours, Counseling measures were also insti- 
tuted to insure that students were prepared for the telecourses in 
which they were enrolled and that their course load was not too 
heavy: Conference sessions were scheduled to help the students 
with difficult material. Assignments were designed to allow positive 
feedback and exams related to the course objectives. 

Summary 

Researchers have concluded that telecourse students are, in 
general/ highly motivated with one or two years of college credits. 
They are older ; working, retired, or caring for children. They 
cannot or do not want to come on to a campus to take a particular 
class. a 

The literature showed that properly designed telecourses were 
generally as effective as the parallel on -campus ^courses. Thus, It 
was appropriate to evaluate the telecourse program at Saddleback 
College by direct comparison between telecourses and parallel 
on-campus courses. 

The literature has shown student attrition to be a problem 
both in telecourses and on-campus courses. Because their reasons 
are mainly nonacademlc, there Is little that can be done to prevent 
students from withdrawing from college. The students that can be 
helped are the ones <who withdraw from a class. Researchers have 
concluded that person*! contact between student and instructor 
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helps reduce the class withdrawal rate. This is especially true in 
telecourses, where there is almost no student-instructor contact 
and the student withdrawal rate is much higher than in on-campus 
courses. 

The review of the literature aided in the construction of the 
telecourse student questionnaire. The literature indicated that no 
single factor was the cause of attrition. Sex and age, while not 
strong factors, did have some effect on attrition (Pantages and 
Creedon, 1978). . Academic factors were found to account for at 
least half the variance between finishers and non-finishers. High 
school Grade Point Average (GPA) and scholastic aptitude were 
significant factors in predicting persistence. If a student was 
already in college, the college GPA was also a factor in determining 
persistence. While the general conclusion was that there is no way 
to assess how motivational forces predict college success, there is 
some feeling that student goals affect persistence (Astin, 1975). 
According to the literature, the student's major has an effect on 
the persistence rate (Newlon and Gaither, 1980). All of these 
factors were specifically incorporated into the design of the student 
questionnaire. 
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CHAPTER III 



PROCEDURES AND METHODOLOGY 



"Ota 

The purpose of this study was to, evaluate fthe telecourse 
program at Saddleback College. Three' ^aspects Were addressed: 

1. Student Retention . A questionnaire was developed to compare 
the profile of the students who finish telecdurses/to the profile of 
those students who do not. 

2. Student Achievement . Pre- and post-l3e^s^ere developed to 
compare student achievement between tefecourjses and parallel 
on-campus courses. 

3. Student Satisfaction . A questionnaire was developed to 
assess satisfaction with the telecourse program/ as perceived by 
those students who finished. 
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Student Retention 

Methodology 

The descriptive method of research was used to determine the 
profile of those students who finish and the profile of those students 
who fail to finish telecourses. Since the intent was to compare the 
profile of the finishers to that of the non-finishers, no hypothesis 
was tested. Percentages were used to compare the responses of 
these two groups. A questionnaire (Appendix A) was developed to 
be given to all enrolling telecourse students. After the completion 
of the course, the questionnaires were separated based on whether 
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or not the students completed the course. A composite profile was 
then developed for each group based on the questionnaires. 

i > 

Developing the Questionnaire """^jf ' * 

A review of the literature on telecourse and on-campus course 
student retention aided In the formation of the questions. While 
no single factor was Indicated to be the cause of attrition/ the 
literature concluded that age, sex, high school and college Grade 
Point Averages, and scholastic aptitude were significant factors in 
predicting persistence (Pantages and Creedon, 1978). Astin 
(1975) reported that while there is presently no way to assess 
quantitatively to what degree motivational forces predict college 
success, student goals and future plans clearly affect persistence. , 
Newlon and Gaither (1980) also discovered that a student's major 
has an effect on the persistence rate. 

Twenty-seven questions were compiled. Six questions dealt 
with demographic factors: age, sex, racial and educational back- 
ground. Twelve questions involved academic factors: grade point 
averages, number of college units completed, study habits, and 
number of telecourses completed. Six questions related to academic 
goals and future plans. Three questions requested information on 
personal matters: how free time is spent and if the student will 
be studying alone or with a friend. Nine of these questions are 
open-ended in order to allow for maximum response by the student, 
while the other eighteen questions are multiple choice. Open-ended 
questions can also serve as a check on the validity of particular 
student responses. If certain of the open-ended questions overlap 
the multiple choice questions, the data analyst can check the 
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responses for consistancy^ One open-ended question of this type 




\ 



was deliberately included to provide this check. 



V 



Revising the Questionnaire 



The questionnaire was reviewed and revised twice before it 



was given out in a pilot study. 

The first review of the questionnaire was made by the director 
of telecourses at Saddleback College. Recommendations were 
primarily those relating to clarity and arrangement of questions. 
The tentative questionnaire was then revised on the basis of this 
review. - 

The second review of the questionnaire was-by^ the writer's 



Major Applied Research Project Committee. The primary suggestion 
secured from this review was to include an open-ended question 
that would verify multiple choice responses and register degrees of 
feeling. The questionnaire was then revised again by including 
such an open-ended question. The resultant questionnaire was 



Pilot Study 

The questionnaire was given to all students enrolled in tele- 
courses at Saddleback College during the Fall 1982 semester orien- 
tation meeting. Attendance at this meeting was required of all 
telecourse students for the two semesters covered by this study. 
Arrangements were made to allow any student who could not attend 
this meeting to fill out the questionnaire at the college library any 
time during the first two weeks of the semester. Seventy percent 
eTntnV stuclentsT completed questionnaires some Un* Juriny thls- 
peried. Two hundred sixty-two questionnaires were completed. 




used for the pilot study described in the following section. 
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The data from this pilot study were analyzed to aid in validating 
the questionnaire. The analyses indicated that clarification needed 
to be made in the following questions: 



to "Where?" 

2. In question 25 the word "spouse" was changed to "relative." 
A copy of the questionnaire is presented in Appendix A of this 
report. 

• 

The Final Questionnaire 

The final questionnaire was given to all telecourse enrol lees at 
the Spring 1983" semester orientation meeting. As in the case of 
the pilot study, arrangements were made to allow any student who 
could not attend the orientation to fill out the questionnaire at the 
college library any time during -the first two weeks of the semester. 
One hundred five questionnaires were completed. Treatment of the 
data from this questionnaire is described in the following section. 

Treatment of the Data 

The returned questionnaires were checked to verify that they 
had been completed and that the data were in usable form. The 
responses to the overlapping open-ended question (number 27) and 
multiple choice question (number 14) were compared to validate the 
respondant's answers. No invalid questionnaires were detected, 
however, the open-ended question responses provided valuable 
insights that were not available from the multiple choice answers. 
The questionnaires were separated at the end of the semester by 



1. 



In questions 11 and 13 the words "Please specify" were changed 
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Analysis of the Data 

Because the Intent of the questionnaire was to compare the 
profile of the finishers to that of non-finishers, there was no need 
for statistical evidence to confirm or deny any hypothesis. No 
elaborate statistical techniques were used for determining the 
"significance" of the responses to any question of the survey 
instrument. Rather, the percentage obtained for each group was 
compared to the total group for each question. Differences between 
finishers and non-finishers were noted. 

Student Achievement 

Design of the Project 

Student achievement was assessed using four telecourses 
given In the Spring 1983 semester at Saddleback College. These 
telecourses included: (1) Political Science 1— American Government, 
(2) Psychology 33— Understanding Human Behavior, (3) Music 
20— Topic Music, and (4) Marine Science 175— Oceanus. In each 
case, the same instructor taught both the telecourse and the paral- 
lel on-campus course. Outlines of each telecourse and Its parallel 
on-campus course were inspected to Insure that they were identical. 

For each course, a test was developed to be used as both a 
pre- and post-test. This test was developed by the Instructor 
teaching that course in collaboration with the author. The author 
administered each pre-test to the telecourse students at the orien- 
tation meeting. Each instructor administered the pre-test to the 
students in the parallel on-campus course during "the first week of 
the semester. The author was responsible -for administer tag makeup 

ER?C A -, 



39 



pre-tests In the telecourses. Each instructor was responsible for 
administering pre-test makeups in the on-campus course. The 
post-tests were given at the time of the final examination for both 
types of classes. 

Analysis of the Data 

The quasi-experimental method of research was used to test 
the hypothesis "There is no significant difference between the 
post-test scores of the telecourse students and the parallel on- 
campus students." The quasi-experimental research method was 
employed because it was impossible to randomly assign students to 
the two types of classes. An analysis of covariance (Hays, 1981) 
was. employed using the scores from the pre- and post-tests. 

f i 

Prior learning, as determined by the results on the pre-test, is 
controlled statistically when using this technique. The hypothesis 
was tested with 0.05 as the acceptable probability level. 

Student Satisfaction 

Developing the Questionnaire 

It is not only important that as many students be retained as 
possible, but that they have a positive attitude about telecourses. 
In order to assess the students' attitude about telecourses, a 
second questionnaire was given to all telecourse students with the 
final examination. 

The six items were set up in statement format to be responded 
on a six point Likert Scale. Possible responses ranged from 
"Strongly Agree" to "Strongly Disagree." A *»* P°int scale rather 
•that the more common five point scale was used 50 that the res- 
pondents would be unable to choose a "neutral" central value. 
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Pilot Study 

The questionnaire was given to the students who finished the 
t telecourses during the Fall 1982 semester- The data from this 
pilot study were analyzed to aid In validating- the questionnaire. 
The analyses indicated that the questionnaire was adequate for the 
study. A copy of this questionnaire is presented in Appendix B. 



Analysis of the Data 



Because the intent of the questionnaire was to assess student 

satisfaction with telecourses, no elaborate statistical techniques 

were used for determining the "significance" of the responses to 

any statement of the survey instrument. Rather, each response 

was given a weighted value according to the following scale 

Response Weighted 

Value 

1 - Strongly Agree 1 point 

2 - Mostly Agree 2 points 

3 - Mildly Agree 3 points 

4 - Mildly Disagree 4 points 

5 - Mostly Disagree 5 points 

6 - Strongly Disagree 6 points 

4 in order to assess student satisfaction, a mean score of the 
weighted values of responses to each item was computed. The 
data were then analyzed for each telecourse and for the total of all 
four telecourses. 

Summary 

The purpose of this study was to evaluate the telecourse 
program at Saddleback College. Three aspects of this program 
were assessed: (1) student retention, C2) student achievement, 
and (3) student satisfaction* 
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The sample included all the students enrolled in the four 
telecourses offered during the Spring 1983 semester at Saddleback 
College. These telecourses included: (1) Political Science 1-- Amer- 
ican Government/ (2) Psychology 33—Understanding Human Behavior, 
(3) Music 20— Topic Music, and (4) Marine Science 175--Oceanus. 

The descriptive method of research was used to compare the 
profile of the students who finish telecourses to that of those 
students who do not finish. A questionnaire was developed to 
determine demographic data, academic data, academic goals, and 
future plans. One-third of these! questions were open-ended in 
order to allow for maximum response from the student. 

A pilot study was conducted during the Fall 1982 semester. It 
included two hundred sixty-two students enrolled in four tele- 
courses. Based on the results of this pilot study, a revised ques- 
tionnaire was given to telecourse enrollees at the beginning of the 
Spring 1983 semester. Two hundred five students completed the 
questionnaire. 

After the completion of the telecourse, the questionnaires 
were separated based oh whether or not the students finished. 
For each question, the percentage obtained for each group ivas 
compared to the total group. Differences between finishers and 
non-finishers were noted. 

The quasi-experimental method of research was used to assess 
student achievement. Each telecourse offered at Saddleback College 
for the Spring 1983 semester was tested against its parallel on- 
campus course. Pre- and post-tests were given to all students 
enrolled in telecourses and a parallel on-campus course. An 
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analysis of covarlance was employed to determine whether there 
was any significant difference between the amount of learning 
achieved by the telecourse students and that achieved by the 
parallel on-campus students, as shown by the post-test scores . 

A questionnaire was also developed to assess student satis- 
faction with the telecourse program- Students were asked to 
respond to six statements. The . statistical analysis consisted of 
assigning a weighted value to each response and calculating the 
mean response score for each question. These mean scores were 
analyzed for each telecourse and for the total of all four tele- 
courses. 
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CHAPTER IV 

PRESENTATION AND ANALYSIS OF THE DATA 

! The purpose of this study was to evaluate three aspects of 
the telecourse program at Saddleback College: (1) student retention, 
(2) achievement, and (3) ; satisfaction with the program. The 
sample for this study included all telecourse students and on- 
campus students enrolled in the following courses: (1) Political 
Science 1, (2) Psychoiogy 33, (3) Marine Science 175, and (4) 
Music 20. The Uample was limited to Saddleback College students 
enrolled in the Spring 1983 semester. 

Student retention data were obtained from college records and 
were correlated with personnel data obtained from a questionnaire 
that was completed by all telecourse students at the beginning of 
the semester. Two hundred five questionnaires were completed 
and used in this study. Each completed questionnaire was checked 
for completeness, and the composite of all questionnaires was 
analyzed for correlations with scholastic, demographic, and socio- 
economic factors. By fan the most striking correlation between 
finishers and non-finishers was that fifty-eight percent of the 
telecourse students who completed the questionnaire completed the 
-course, while only seventeen percent of the telecourse students 
who did not complete the questionnaire completed the course. 
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Student achievement data were obtained from scores on a test 
given as both a pre-test and post-test. The test was administered 
to both the telecourse students and to the students in the parallel 
on-campus course, for each course evaluated. An analysis of 
covarlance (Hays, 1981) was used to test the hypothesis "there Is 
no difference between the post-«test scores, of the telecourse students 
and the parallel on-campus students."- No significant differences 
In achievement between- telecourse students and students In the 
parallel on-campus courses were observed. 

Satisfaction with the telecourse program was evaluated through 
a second questionnaire provided to all telecourse students. This 
questionnaire was given to all telecourse students who finished the 
course in which they were enrolled. -Of the 151 telecourse finishers, 
118 answered the questionnaire. The majority of these students 
indicated that they were satisfied with the telecourse they had 
taken. 

Part A of this chapter focuses on describing the findings of 
the questionnaire that was developed to assess student retention. 
The central theme of Part B of this chapter is the analysis and 
presentation of the student achievement data obtained from the 

pre- and post- tests. Part C of this chapter concentrates on the 

» 

findings of the student satisfaction questionnaire- 
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«. • PART A 

o . * .. . 

ANALYSIS AND PRESENTATION OF STUDENT RETENTION DATA 

' ' \ ' 

A twenty-seven Item questionnaire was developed to assess 

\ ' " • ■•' '•■ 

student retention. This questionnaire was given to all telecourse 

enrollees at the orientation meeting. Of the 400 telecourse en- 

rollees, 205 filled out the questionnaire. After the conclusion of 

the course, the questionnaires were separated into two groups: 

finishers and non-finishers. The responses of the two groups to 

each question were compared. J 

Table 1 presents the distribution of the responses for the 

u first twenty-six questions. The open-ended responses to question 

27 paralleled the responses to question 14. Graphs of these re- 

sponses can be found in Appendix C. 

Findings 

Responses to twenty-one of the questions Indicated no differ- 
ence between finishers' and non-finishers. However, for five of the 
questions, the finishers tended to differ from the non-finishers. 
Finishers indicated „ they preferred to study alone. Consistently, 
fewer of them were taking the telecourse with a friend or relative 

/ o . 

\ ■ i ■> , . 

than the non-finishers. TheV were more likely to be taking tbe 
course for degree requirements^ or career advancement. Responses 
of non-finishers indicated that they had more problems taking 
classes on campus than did the finishers./- They were also less 
likely than finishers to have taken telecokrses previously. 

The- most striking comparison between finishers and non- 
■finishers does not appear in the responses they provided, but 



TABLE 1 

DISTRIBUTION OF RESPONSES TO QUESTIONNAIRE 



Question 


- ■ 


Response(%) 




Finishers 


Non 

Finishers 


Composite 


#1 Sex 






37 


Male 


36 


37 


Female 


64 


63 


63 , 


#2 Age 








17 or below 


2 


5 


3 


18-22 


26 


25 


26 


23-27 


19 


20 


20 


28-33 


18 . 


13 


16 


34-39 


16 


17 


17 


40-49 


12 


15 


13 


50 or over 


7 


6 


6 


#3 Marital Status 

Single 

Married 

Divorced 


41 
48 
11 


39 
53 
8 


40 

50 
10 



#4 Ethnic Background 

Asian e 3 6 J 

Black 0 0 0 

Hispanic 0 0 0 

Caucasian 96 94 96 

Other 2 0 1^ 

#5 Number of years 

since l ast attended school 

0 i 81 80 81 

1- 5 • 11 14 12 
6-10 4 6 5 
11-15 2 0 1 
16-20 1 0 ' ] 
over 20 1 0 1 



4*6 Highest Educational 
Level Completed 
Below 12th grade 
High School grad 
0-30 college units 
31-60 college units 
over 60, no degree 
AA degree 

Bachelor's Degree or above 



2 7 4 

6 7 6 

31 26 29 

36 41 39 

8 6 7 

11 8 10 

6 5 5 



TABLE 1 (Continued) 
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Question 

- 




Response(%) 




Finishers 


Non 
Finishers 


Composite 


#7 High School grades 






18 


A 


16 


17 


B 


53 


52 


52 


C 


28 


28 


28 


Did not graduate 


0 


1 


1 


no response 


2 


2 


2 



#8 College grades 

A 25 23 24 

B 47 48 47 

C 18 17 18 

First semester 8 8 8 

no response 3 3 « 3 



#9 Units completed 
at Saddleback 
0 

I- 5 
6-10 

II- 15 
16-20 
over 20 

no response 



16 
9 

14 

13 
5 

39 
4 



26 
7 

13 
7 
6 

39 
2 



20 
8 

13 

10 
5 

39 
3 



#10 Total units 
enrolled Fall semster 

I- 5 
6-10 

II- 15 
16-20 
over 20 



14 
44 
31 
11 
0 



14 
45 
33 
7 
1 



14 
44 
32 
9 
1 



#11 Enrolled at 
other institution? 
yes 
no 



15 
85 



9 
91 



13 
87 



#12 Primary 
occupational status 
Full-time housewife 
Full-time employed 
Part-time employed 
Retired 
Unemployed 



13 
42 
33 
2 
10 



11 
48 

29 
2 
9 



12 
45 
31 
2 
10 
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TABLE 1 (Continued) 



Question 



#13 Possible to take 
courses on -campus? 
yes 
no 



Finishers 



88 
12 



Response(%) 



Non 
Finishers 



78 
22 



Composite 



84 
16 



#14 Reason for en- 
rolling in TV class 
on -campus course 
unavailable 
transportation 
babysitter 
health 
time better 

fewer scheduled hours 
other f 



3 
6 
7 
0 
68 
13 
3 



3 
5 
9 
3 
60 
20 
0 



3 
5 
8 
1 
64 
16 
2 



#15 Reason for 
taking course 
for degree 
general interest 
career advancement 



76 
22 
2 



69 
30 
1 



73 
25 
1 



#16 Plans to- enroll next 
semester at Saddleback 
yes 

no » 

undecided 



96 

3 
1 



#17 Plans to enroll in a 
TV course next semester 
yes 
no 

undecided 



63 
25 
13 



98 
1 
1 



61 
22 
17 



97 
2 
1 



62 
23 
15 



#18 Number of TV courses 

previously enrolled 

0 

1 

2 

3 

4 

5-10 



63 


71 


66 


19 


17 


19 


9 


6 


8 


3 


3 


3 


2 


1 


1 


3 


1 


2 
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TABLE 1 


(Continued) 




Question 




Response(%) 






, Finishers 


Non 
Finishers 


Composite 


#19 TV courses taken 
at other colleges 
yes 
no 


25 
75 


20 
80 


23 
77 


#20 TV courses: 

C or better 

0 

1 

2 

3 

4 

5-10 


2 
52 
25 
7 
5 
9 


4 

12 
16 
4 
0 


3 

Di 

20 
10 

. 4 

/ 6 


#21 Description of 
study habits 
study with others 
study alone 


5 
95 


18 

82 


11 
89 


#22 Primarily seek help 
Instructor 7 
Classmates 
Tutor 

Family . 
Books 


70 
14 
4 
3 
8 


JO 

21 
0 
1 

3 


1 c 

17 
2 
2 

.6 


#23 Hours of free time 

spent watching TV 

0-5 

6-10 

11-15 

16-20 

over 20 ( 


A A 

44 
32 
13 
8 
3 


oo 
33 
11 
9 
8 


33 
12 
8 
5 


#24 Hours of free " 
time spent reading 

U-D 

6-10 
11-15 
16-20 
over 20 


37 
38 

9 
10 

5 


48 

29 
10 
9 

3 


42 
34 
10 
10 
4 



TABLE 1 (Continued) 



Hi i Dctlnn 

yucsiiui I 




Response(%) 




Finishers 


Non 

ill 1191 Ivl 9 


Composite 


#25 Taking TV course 
with friend/relative 
yes 
no 


19 
81 


34 
66 


26 
74 


#26 Major 




75 


75 


Declared Major 


75 


Undeclared Major 


25 


25 


25 
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rather in the responses they did not provide. Of the 205 telecourse 
students who completed the questionnaire, 118 (or 58%) completed 
the course. Of the 195 telecourse students who did not complete 
the questionnaire only 33 (or 17%) completed the course. The total 1 
number of students enrolled in the telecourses evaluated was 400. j 

I 

Of these, 151 (or 38%) completed the course. / 

/ 
/ 

Table 2 presents a summary of the responses to the first 26 
questions. • / 



TABLE 2 



QUESTIONNAIRE SUMMARY / 
Comparison Between Responses of Finishers and Non- Finishers 



Question 








Comparison / 


1 


No 


difference 


in 


sex. / 


2 


No 


difference 


in 


age. / 


3 


No 


difference 


In 


marital status. / - 



4 No difference in ethnic background. 

5 No difference in number of years since last attended school. 

6 Np difference in the amount of education. 

7 No difference in high school grades. 

8 No difference in college grades. 

9 No difference in the number of units completed at Saddleback. 

10 No difference in total units enrolled Fall semester. 

11 No difference in whether enrolled at other institutions. 

12 No difference in primary occupational status. ° 
13* Finishers have less trouble taking classes on campus. 

14 No difference in reasons for enrolling in telecourse. 

15* More finishers were taking course for a degree. 

16 No difference in plans to enroll at Saddleback next semester. 

17 No difference in plans to enroll in TV course next semester. 
18* More finishers have previously enrolled in a TV course. 

19 No difference in TV courses taken at other colleges. 

20 No difference In previous TV courses completed. 
21* Finishers prefer to study alone. 

22 No difference in where students seek help. 

23 No difference in hours of free time spent watching TV. 

24 No difference in hours of free time spent reading. 

25* Fewer finishers were taking TV course with friend/relative. 

26* Finishers were more likely to have declared a major* 

* Questions where a difference Is noted . 

- : GO . ;..^> 
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PART B 

ANALYSIS AND PRESENTATION OF STUDENT ACHIEVEMENT 

DATA 

An analysis of covariance (Hays, 1981) was used to test the 
hypothesis "there Is no significant difference between the post-test 
scores of the telecourse stuctents and the parallel on-campus stu- 
dents. 11 The hypothesis was tested with 0.05 as the acceptable 
probability level. 

Music 20— Topic Music 

Hypothesis : There is' no significant difference between the post- 
test scores of the telecourse students and on-campus students 
enrolled In Music 20 for the Spring 1983 semester. 
Presentation of Findings : The data gathered from the s^re- and 
post-tests administered to telecourse and on-campus course students 
enrolled in Music 20 are shown in Table 3. 





TABLE 


3 




COVARIANCE 


ANALYSIS OF 


MUSIC 20 TEST SCORES 




Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 
Squares 


Total 

Between Classes 


28 
1 


452.37 
50.50 


50.50 


Within Classes 


27 


401.87 


14.88 


F * 50.50/14.88 = 3.39 


(Not Significant) 
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Findings : The F value necessary for significance at the 0.05 

* \ 

level, for 1 and 27 degrees of freedom is 4.21. Thus, the 
hypothesis of no difference between the\two groups may be accept- 
ed. The two groups do not differ In performance, as measured by 

\ • ^ 
tfie post-test. a ^ 

\ 

Psychology 33--Understandlng Human Behavior^ 

\ 
\ 

Hypothesis : There is no significant difference between the post- 



test scores of the telecourse studentu ar|d on -campus students 
enrolled In Psychology 33 for the Spring 1983 semester. 
Presentation of Findings : The data gathered from the pre- and 
post-tests administered to te!ecourse and on-campus course students 
enrolled in Psychology 33 are shown in Table 4. 

TABLE 4 



COVARIANCE 


ANALYSIS OF 


PSYCHOLOGY' 33 


TEST SCORES 




Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares: 


Mean 
Squares 


Total 

Between Classes 


25 
1 


3816. S2 \ 
310.40 \ 


310.40 


Within Classes 


24 


3506.22 


146.09 



F = 310.40/146.09 = 2.12 (Not Significant) 



Findings : The F value necessary for significance at the 0.05 
level, for 1 and 24 degrees of freedom is 4#2 ^. Thus, the 
hypothesis of no difference between the two groups may be accept- 
ed. The two groups do not differ in performance, a^ measured by 
the post-test. 
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Marine Science 175— Oceanus 

Hypothesis : There is no significant difference between the post- 
test scores of the telecourse students and on-campus students 
enrolled in Marine Science 175 for the Spring 1983 semester. 
Presentation of Findings : The data gathered from the pre- and 
post-tests administered to telecourse and on-campus course students 
enrolled In Marine Science 175 are shown in Table 5. 



TABLE 5 

COVARIANCE ANALYSIS OF MARINE SCIENCE 175 TEST SCORES 



Source of 1 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 
Squares 


Total 

Between Classes 


11 
1 


1082.80 
79.45 


79.45 


Within Classes 


10 


1003.35 


100.34 


F = 79.45/100.34 = .79 


(Not Significant) 





Findings : The F value necessary for significance at the 0.05 
level, for 1 and 10 degrees of freedom is 4.96. Thus, the 
hypothesis of no difference between the two groups may be accept- 
ed. The two groups do not differ in performance, as measured by 
the post- test. 0 

Political Science 1— American Government 

Hypothesis : There is no significant difference between the post- 
test scores of the telecourse students and on-campus students 
enrolled in Political Science 1 -for the Spring 1983 semester. 
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Presentation of Findings : The data gathered from the pre- and 
post-tests administered to telecourse and on-campus course students 
enroled in Political Science 1 are shown in Table 6. 

S TABLE 6 



COVARIANCE ANALYSIS OF POLITICAL SCIENCE 1 TEST SCORES 





Source of 
Variation 


Degrees of 
Freedom 


Sum of 
Squares 


Mean 
Squares 


Tot<il N 
Betvyeen Classes 


13 
1 


982.11 
229.44 


229.44 


Within Classes 


12 


752.67 


62.72 



F = 229.44/62.72 = 3.66 (Not Significant) 

Findings : The F value necessary for significance at the 0.05 
levejl, for 1 and 12 degrees of freedom is 4.75. Thus, the 
hypothesis of no difference between the two groups may be accept- 
ed.) The two groups do not differ in performance, as measured by 
the post-test. 
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PART C 



ANALYSIS AND PRESENTATION OF STUDENT SATISFACTION 

DATA 



In order to assess student satisfaction, with the telecourse 
program, a six item questionnaire was given to\those students who 
finished. Of the 151 telecourse finishers, 118 answered the ques- 
tionnaire. The questionnaires were grouped by telecourse. Each 
response was given a weighted value according to v the following 
scale: 



\ 



Response Weighted 
" Value d 

1 - Strongly Agree 1 point 

2 - Mostly Agree 2 points 



3 - Mildly Agree 3 points 

4 - Mildly Disagree - 4 points 



\ 

5 - Mostly Disagree 5 points \ 

6 - Strongly Disagree 6 points 



\ 

\ 



A mean score of the weighted values of responses to each item was 
computed. Table 7 shows the mean score for each item by tele- 
course and for the composite. f 

TABLE 7 

SUMMARY OF MEAN SCORES RELATED TO 
STUDENT SATISFACTION WITH TELECOURSES 



Item Number 

Course 1 2 3.-4 



Marine Science 175 2.4 3.4 3.4 3.5 2.7 1.5 

Political Science 1 2.1 3.2 3.5 4.0 2.5 2.5 

Psychology 33- 2.2 3.4 4.3 4.5 2.6 1.6 

Music 20 1.7 . 2.9 4.0 4.6 2.0 1.7 



Composite 



2.1 3.2 3.8 4.2 . 2.4. 1.8 



^Findings 
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Statement 1 : 



ii 



I am pleased that I took this telecourse instead 



of the equivalent on-campus course. 11 A mean score of 1.9 Indicated 
that the students "mostly agreed" with this statement. 

Statement 2: "The telecourse taught me more than the equi- 
valent on-campus course." The mean score of 2.9 indicated that 
students only "mildly agreed" with the statement. 

Statement 3: "The telecourse was less work than the equi- 
valent bn-campus course." Students "mostly disagreed" with this 
statement as is Indicated by a mean score of 3.7. 

Statement 4: "The telecourse was graded easier than the 

equivalent on-campus course." A m6an score of 4.2 indicated that 

i 

students "mostly disagreed" with this statement. _ 

Statement 5: "If a future class I plan to take is offered both 
by telecourse and on-campus, I will take the telecourse." Students 
"mostly agreed" with this statement as a mean score of 2.3 in- 
dicates. 

Statement 6: "I would definitely recommend this course to a 
friend.? 1 ^ A mean score of 1.8 indicated that students "mostly 
agreed" with this statement* 

Students also commented that telecourses were difficult because 
of the need for self-discipline. .They felt that on-campus courses 
were easier because "an Instructor Is a constant reminder that you 
have homework or other projects due." 
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CHAPTER V 

i 

SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 

The purpose of this study was to evaluate the telecourse 
program at Saddleback College. Three aspects were addressed: 
(1) student retention, (2> student achievement, and (3) student 
satisfaction. 

Student Retention 

o 

) 

Data Collection Procedures 

A questionnaire was^d^veloped for use in this study. The 
questions dealt with demqgraphic factors, academic factors, and 

academic goals and future plan^. 

I 

The sample 'for this study included all students enrolled 

/ / " 

during the Spring 1983 semester jn the following telecourses u (1) 



Psychology 33, (/2) Political Science 1, (3) Marine Science 175, and 
(4) Music 20. /The questionnaires were completed either during 
the telecourse drientation meeting or during the first two. weeks of 
the semester. /Out of an enrollment of 400 telecourse students, 205 

completed the Questionnaire. q ^ 6 

/ ° 

Treatment of/the Data \ o fc 

At the end/of the semester, thes0 questionnaires were separated^ 
based on whether or not the students completed the course. A 
composite^rofile was then developed for each group based on the 
questionnaires. ""in order to compare the profile of the finishers to 
that/ of nbn-fmishers, percentages were obtained for each group. 



These percentages were compared (to the total group for each 
question. Differences between finishers and non-finishers were 
noted. g 

Findings 

Analysis of the questionnaires revealed slight differences 
between finishers and non-finishers. Finishers, preferred to study 
alone and had fewer friends or relatives taking the course with 
them. They were also more likely to be taking the course for 
degree requirements. The most striking comparison was between 
those students who completed the questionnaire anek those who did 
not. Of the 205 students who completed the questionnaire, . fifty- 
eight percent finished, while only seventeen percent of those who 
did not complete the questionnaire finished. 

Student Achievement 

r Data Collection Procedures 

In order to assess student achievement, a test was developed 

to be used as both a pre- and post-test. This test was developed 

/ 

/ 

by. the instructor teaching that course in collaboration/ with the 
author. This test was given at the beginning of the semester in 
both the teiecourse and parallel on-campus course. It was also 
given at the time of the final examination for both types of classes. 

Treatment of the Data 

An analysis of covariance was employed using the scores from 
the pre- an d_^ post-tests to test the hypothesis: "There is- no. 
significant difference between the post-test scores of the teiecourse 
students and the parallel on-campus students. 11 
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Findings 

In each case, the test results indicated that the null hypoth- 
esis could be accepted. Thus, there was no significant difference 
In the amount of learning between telecourse students and parallel 
on-campus students . 

* Student Satisfaction 

Data Collection Procedures 

A six item questionnaire yvas developed to assess student 
satisfaction. The six items were set up in statement format to be 
responded on a six point Likert scale. Possible responses ranged 
from "Strongly Agree" to "Strongly Disagree." By using a six 
point scale/ respondents could not choose a "neutral" central 
value. 

Treatment of the Data 

Each answer was given a weighted value of 1 to 6 poinu2^-1 
mint for each ^Strongly Agree" response and 6 points for each 
^Btrorjgly Disagree" response. The mean score of the weighted 
responses for each statement was computed. ' sfaction with the 
telecourse, program, as perceived by those stt - *ts who finished, 
was assessed ton the basis of these mean scores. 

Findings 

Mean scores radicated that students "mildly agr$$d" that the 
telecourse taught them more than the on-campus course. However, 
students "mostly agreed" that they were pleased to have taken the 
tfcfecourse, would recommend it tr> a friend, and-woutaf $&&e another 



/• 

/ 

/ 
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/ 

one. They "mostly disagreed" that the telecourse was graded 
easier or was less work than an on-campus course. / 



Conclusions j 

j 

The purpose of this study was to evaluate three aspects of 
the telecourse program /at Saddleback College: (21) student retention, 
(2) student achievement, and (3) student satisfaction. 



The results of a/ questionnaire used to assess student retention 
indicated that stydents who completed the courses were more likely 
to be taking the course for degree requirements or career advance- 
ment than students who failed to finish^ Students taking their 

first telecourse were less likely to finish than students who had 

\ ■ ' ' / ' 

previously enrolled in one or more telecourses. Students commented 



that self-motivation was a problem In completing a telecourse. 
Perhaps related is; the fact that more finishers indicated that they 
preferred to stud^ alone rather than with a friend than did non- 
finishers. Finishers, also had fewer friends or relatives taking the 
course with them than did norfinishers. Perhaps also related to 
motivation was the fact that more non-finishers than finishers 

&*d)cated that it was impossible for them to attend classes on campus. 

\ j m 

fef.4iv»liein apparently also played a part in the most dramatic 

«s«^fc>i$ &? tKis study. fifty-eight percent of those who had com- 

prelva # questionnaire finished the course* in which they were 

enrol li^i c but only seventeen percent of those who did not complete 

the questionnaire finished the course In which they were enrolled. 

The analysis of covariance used to test the hypothesis "There 

is no difference between the post-test scores of tefecourse students 
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and parallel on-campus students" indicated that the hypothesis 
could be accepted. 'Thus, there is no difference in the amount of 
learning that took place in the telecourses compared to the parallel 
on-campus courses. Since the two types of classes had the same 
book and course outline, the courses were equivalent. 

The results of the questionnaire used to assess student 
satisfaction indicated that students were generally satisfied with 
the telecourse they had taken. Since this questionnaire was only 
given to students who had completed the course, no conclusion 
could be drawn concerning the attitudes of the telecourse enrollees 
who failed to complete the courses. 

Implications and Recommendations 

Periodic review of the effectiveness of telecourses is necessary 
not only at Saddleback College, but at every college that offers 
telecourses. This study attempted to satisfy that need by evaluating 
three aspects of course effectiveness: (1) how many students 
completed the courses, (2) how much those students learned, and 
(3) how satisfied were the students with the program. 

In evaluating the fraction of the enrollees who completed the 
courses, this study attempted to identify characteristics that were 
common to students who failed to complete their courses. 

The most striking fact noted was that eighty-three percent of 
the students who failed to attend the orientation meeting for their 
telecourse also failed to complete the telecourse. Consequently, It 
is recommended that, to increase student retention, more initial 
activities, such as the orientation meetmg, should be planned. 

ERIC 7j. 
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These meetings should be made part of the course requirement. 
Student retention can be Increased by dropping the students who 
do not participate in the initial activities. While Shly 38 percent of 
the total telecourse enrollees finished, If the students who failed to 
finish the questionnaire had been dropped, the completion rate 
would have increased to 58 percent. 

More Initial counseling of students should be done. Younger 
students with less experience In taking college courses should be 
counseled to take on-campus courses. Students without a definite 
reason for taking the course should not be encouraged to take a 
telecourse because motivation is a large factor in successful com- 
pletion . 

This study should be continued through the 1983-1984 school 
year to see if the same trends occur each semester. The differ- 
ences noted between finishers and non -finishers for the 1983 
Spring semester may be due in part to the particular courses 
offered. A similar questionnaire should be given to the on-campus 
counterparts. A comparison of finishers and non-finishers in each 
course should be analyzed to ascertain any differences between 
telecourse and parallel on-campus students. 

The director of telecourses at Saddleback College had discussed 
the possibility of organizing study groups for the students. In 
hopes of increasing student retention. However, this study In- 
dicated that when a student studied with a friend or relative it 
had a negative effect on the student's probability of completing the 
course. In addition, only eleven percent of the students (finishers 
and non-finishers combined) indicated any interest In studying 
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with others. Consequently, it is recommended that no extra staff 
effort be devoted toward organizing study groups for telecourse 
students. ^ 

The comparison in educational achievement between the tele- 
courses and the parallel on-campus courses was intended to provide 
guidance on what types of courses should be offered via television, 
and what formats should be employed. These results are of great 
current interest in Orange County, California. Due to the reduction 
in college funding caused by the passage of Propostion 13, the 
property tax initiative of 1976, colleges are rigorously evaluating 
all educational formats. This is of immediate concern at Saddleback 
College were intense discussions are continuing on the validity of 
telecourses. It is also of great concern in Coast Community College 
District (California) where a group of faculty members have formally 
petitioned the California State University to assert that telecourses 
are not comparable to on-campus courses. 

The results of this study produced no evidence to indicate 

■7 

that the amount of learning is different in a telecourse than in a 
parallel on-campus course. Based on this fact and the fact that 
student satisfaction with telecourses was found to be very positive, 
no changes are recommended in the number, type, or content of 
telecourses offered at Saddleback College. 

Diffusion and Implementation 

Whenever innovative teaching methods are employed, evaluation 
of these methods should take place. At Saddleback College, four 
-telecourses have been evaluated with respect to retention, achieve- 
ment, and satisfaction. The findings of this study Should be made 
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available to the educational community at lat^ge and to interested 
persons and agencies at Saddleback College and the Galifornta 
community college ^system: To accomplish this, copies of this 
paper are being distributed to the Southern California Consortium 
for Community College Television/ the Vice Chancellor of Academic 
Affairs for the California State University, and the ERIC Clearing- 
house for Junior Colleges. The findings will also be presented to 
the academic senate of Saddleback College and the Coast Community 
College District. 
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APPENDIX A ., , 

7f75 

Questionnaire Student Profile . 
SADDLEBACK COLLEGE TE&ICOURSE QUESTIONNAIRE 

• The purpose of this qatstloririaire so determine a profile of 
those students who enroll sln/tet^ourfcfts' . I4sase help us by answer- 
ing the following questions. 

Please check only one response ■'&> each question. 

Please fH I In your n&m, course, and date so that at the end 
of the semester, we can separate the data for those who completed 
the course from those who dfd not. Your responses will be com- 
pletely confidential. 7 " 

Please fill 9«t a. ques: opnalre foe* each tetecourse In which 
you are enroled - 



NAM E ' " — — COUR 5 £ — DATE 



Sox 



2. Age 



Male 
Female 



17 or below 
18-22 
23-27 
28-33 • 
34-39. • 
40-49 

50 or over 



3, Marital Status 
Single 

t m " • Married 

Divorced - 

_____ Married but separated 

4. Ethnic Background 

Asian 
_ Black 

Hispanic 
_jg?Caitceslan 
' Middle Eastern 

Other. < please specify) 



Number of ytarjs since last attended school. Put zero if 
attended within the past 12 months. 



2 ^ 

5 76 



6. Highest educational level completed 
^ Below 12th grade 

High School graduate 

0-30 college units ! 

' 31-60 college units % C-~ 

over 60 college unjts but no diploma or degree 

" A A degree 

Occupational Certificate; 

4. Bachelor's Degree or above 

7. What was your' high school Grade Point Average? 

A B C Did not graduate 

A- ' B- C- 

- B+ C+ ! . ; D 

8/ What is your current college Grade Point Average? 

.A m B . G First semester 

A- B- C- 

B+ O D 

9. How many units have you completed at Saddleback? 



10. Including this class, how many total units are you enrolled 
this semester (Saddleback or another Institution)? 



11. Are you taking any courses at another institution this semester? 
Yes (Where?) '» • 

_ No 

12. Primary Occupational Status 

Full-time housewife 
'■ . Full-time employed 

Part-time employed £0 hours or more 
• Part-time employed less than 20 hours 

. Retired 

Unemployed 

. ' ■ i 

13. Is It possible for you to take courses on campus? 
_ Yes 

No ^ 

( 

14. What was your most important reason for enrolling In a TV 
course instead of an on-campus course? 

_ Class I needed not available on-campus 

Transportation problem 
* Baby-sitter problem I 
"™ Health problems \ 

I can register later 

Class time better for me 
m Fewer scheduled class hours 

^ Other (Please specify) ; _ 
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3 

77 



15. Of the following, which best answers the question: Why are 
you taking this course? 

Needed for my degree/certificate program 

General Interest in the subject 

Career advancement but my plans do not include a degree 
Other (Please Specify) . 

16. Do you plan to enroll for classes at Saddleback or any other 
college n&vt, semester? 

Yes 

No 

17. Do you plan to enroll in a telecourse next semester?* 
Yes 

No , ' 

18. How many teJecourses have you enrolled in before this semester 
(Saddleback or another institution)? 



19. Have you taken telecourses at other colleges? 

Yes (Where?) _^ ; 

No 

20. In how many telecourses have you received a grade of C or better? 



21. Which best describes your study habits? 

_ \ I prefer to study with other students 

I prefer to study by myself . 

22. When a course is ^difficult, where do you primarily seek help? 

the Instructor 
classmates 

tutors 

other (Please specify) ; a \ 



23. How many hours of your free time do you spend watchto^ TV mch week? 



24. How many hours of your free time do you spend reading each week? 



25. Are you taking this telecourse with a friend or relative? 
Yes 

No 

26. What is your major? 



27. Why have you enrolled in this TV course Instead of in the on- 
campus course? 
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APPENDIX B 
Questionnaire: Student Satisfaction 
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SADDLEBACK COLLEGE TELECOURSE QUESTIONNAIRE 



The purpose of this questionnaire is to evaluate the teiecourse 
program. Your responses are necessary to planning improvements 
in the quality of teiecourse programs offered at Saddleback College. 
Please respond to the questions on the basis of your experiences 
this semester. 

Please respond to the extent to which you agree or disagree 
with the following statements. Mark an "X" in the box which best 
represents how you feel about the statement. 



0 



9 O) 2 s 



2 « 



if) 



0) 
0) 
t_ 
O) 

m 

(A 



>* < < r 



cn « 
5 > 



'i s w 



1. i am pleased that I took this teiecourse ( ) 
instead of the equivalent on-campus course. 

2, The teiecourse taught me more than the { ) 
equivalent on-campus course. 

3. The teiecourse was !ess work than the ( ) 
equivalent on-campus course. 

4. The teiecourse was graded easier th^n ( ) 
the equivalent on-campus course. 

5, If a future class I plan to take Is offered ( ) 
both by teiecourse and on-campus, I 

will take the teiecourse. 

6, I would definitely recommend this course ( ) 
to a friend. 

Piease note any comments or suggestions below. 
Thank you for assisting us with this evaluation. 
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&*APH5 OF QUESTIONNAIRE RESPONSES 
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QUESTION 3 



FINISHERS 



100. 



NON-FINISHERS 



H COMPOSITE 



\ 



v 



T 



1 I 



Single ferried 



Plvorced 



ERIC 



QUESTION 5 



D 



FINISHERS 



NON-FINISHERS 



Hi COMPOSITE 



r 



i 



r 



i 



pp:T--| ! ' 

■ NX i l£L^J rm-i ri-iLri 



1-5 



6-10 



11-15 



16-20 



Over 20 



erJc M 



NUMBER OF YEARS SINCE LAST ATTENDED SCHOOL 



98 



n FINISHERS 



QUESTION 6 

PS NON-FINISHERS 



m COMPOSITE 



K 



r 



Si 



1 



1 



r 



r 



Below K1gh School 
12th Grade Graduate College Units 



Units 



Over 60 AA Degree 
No Degree 



HIGHEST EDUCATIONAL LEVEL COMPLETED 



93 



Bachelor's 
Degree 

100 



FINISHERS 



100 



NON-FINISHERS 



i COMPOSITE 



L-j 



z 

0 

H 

h 
3 

M 

h 



50 



9 

ERLC 

















\ 



101 



\ 

\ 

\ 



X 



i 



Did Not 
Graduate 



00 



HIGH SCHOOL 6RADB 



102 



QUESTION 8 



D 



FINISHERS 



NON-FINISHERS 



L.j 



i COMPOSITE 



r 



r 



1 

\ 

\ 
\ 

I 



i 



r 



\ 



\ 



\ 



N 
\ 



rrjn 



C 



I 1 






■r 


i I 






i 




First 


Semester 



COLLEGE WES 



104 



QUESTION 10 



D 



FINISHERS 



100, 



NON-FINISHERS 



i COMPOSITE 



r 



\ 

A 

\ 

\ 
\ 



r 



HA 



\ 



v 



1 



V" "1 



1-5 



6-10 



11-15 



16-20 " over 20 



TOTAL UNITS ENROLLED FALL SEMESTER 



1 hit) 



10 



100, 



QUESTION 12 , 



D 



FINISHERS 



iraSHERS 



H, COMPOSITE 



r 



r 



i 



V 
ill 



I 



\ 

\ 



1 



r 



1 



Full-Tlme 
Housewife 



Full-Tlme 
Employed 



ERIC 



?rli 



Part-Time - Retired 
Employed 

r 

PRIMARY OCCUPATIONAL STATUS 



Unemployed 
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QUESTION 13 



n 



■3 

A 

\ 
\ 

\ 
\ 
\ 

\ 
\ 

\ 
\ 

\ 



1 



i i 
il 



Ves 



-\ 

\ 

No 



s 



1 



FINISHERS 



NON-FINISHERS 



m COMPOSITE 

L-j 



POSSIBLE TO TAKE COURSES ON CAMPUS? 



QUESTION 14 



D 



FINISHERS 



NON-FINISHERS 



\ 



i COMPOSITE 



u Tin 



L N1 



On-campus Class Transportation Babysitting Health 
Unavailable 



3 

\ 

\ 
\ 



1 



V'i 

ERIC 



REASON FOR ENROLLING IN TV CLASS 



r 



\ 

\ 



1 




Fetief Other 
Scheduled Hours 



QUESTION 15 



FINISHERS 



NON-FINISHERS 



r-i 



i COMPOSITE 



•I 



1/ 



« 1 

\ 

I 

\1 




N 1 



For Degree .* General Career 
Interest Advancement 



REASON FOR TAKING COURSE 



QUESTION 16 



r 



\ 

\ 
\ 

\ 
\ 
\ 

\ 
\ 
\ 

\ 
\ 

V 

* 

\ 
\ 

\ 
\ 
\ 

\ 

\ 
\ 
\ 
\ 

N 

i 

V i 

iN 



NON-FINISHERS 



ri COMPOSITE 



yes 



No 



Undecided 



.U9 

ERJC 



PLANS TO ENROLL NEXT SEMESTER AT SADDLEBACK 
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QUESTION 17 



D. 



FINISHERS 



100 



NON-FINISHERS 



4fi COMPOSITE 



L.j 



Z 

0 



r 



CO 

H 

M 
0 



\ 

\ 
\ 
\ 

\ 



1 



r 



\ 

\ 



\ 



r 



i 



No Undecided 



121 
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PLANS TO ENROLL IN A TV COURSE NEXT SEMESTER 
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QUESTION 18 



D 



FINISHERS 



NON-FINISHERS 



T"! COMPOSITE 

L.J 



R 

r."'"\" 

■\ 

\ 
\ 

\ 
\ 

\ 
\ 



0 



r 



1 



\ 1 1 



^ I [ffl] dJ^ r 



1 



3 



5-10 



NUMBER OF TELECOURSES PREVIOUSLY ENROLLED 



FINISHERS 



NON-FINISHERS 



m COMPOSITE 

im4 



TELEGOURSE-S TAKEN AT OTHER COLLEGES 



QUESTION 20 



o 



FINISHERS 



NON-FINISHERS 



m COMPOSITE 

L.j 



rk 



i 



r 



2 



3 




jjlELU 



5-10 



er|c!27 



TELEMSES: GRADE C OR BETTER 



12 



QUESTION 21 



FINISHERS 



NON-FINISHERS 



-4, 

M 

Study with 
others 



"1 
I 

\ 

\ 



\ 
\ 



\ 



ii 

Study alone 



n COMPOSITE 



DESCRIPTION OF STUDY HABITS 



QUESTION 22 



100' 



r 



L. 



\ 



\ 



\ 

\ 

\ 

\ 

A 
\ 



i " 



r -j^ i 



D 



FINISHERS 



NON-FINISHERS 



H COMPOSITE 



r 



Instructor Classmates Tutor Family/Friends Books 



o 

PO 



ERJC 
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PRIMARILY SEEK HELP 



QUESTIONAL 



loo. 



NON-FINISHERS 



M COMPOSITE 



z 

0 



5 50 . 



CO 

H 



\ 
\ 

\ 

i 



i \ 
\ 
\ 



TO- 1 



r^ 1 ^ 

uLli nv 



0-5 



6-10 



11-15 



16-20 



over 20 



133 
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HOURS OF FREE. TIME SPENT WATCHING TV 
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QUESTION 24 



FINISHERS 



NON-FINISHERS 



i COMPOSITE 



1 



0-5 



r 



\ 

R 



1 



r 





"i n 




■-I 




"1 


-i i 














N 






Mr - ! 



HO 11-15 16-20 

HOURS OF REE TIME SPENT READING 



over 20 



QUESTION 2E 



□ 



FINISHERS 



NON-FINISHERS 



H COMPOSITE 



r 



I I 



Yes 



9 

ERIC 



\ 
\ 
\ 
\ 
\ 
\ 
\ 
\ 
\ 

\ 

\ 
\ 

\ 

\ 

.11 



No 



TAKING TELECOM WITH A FRIEND/RELATIVE 



' 7 
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100 



5 so 



CD 
H 

Of 

h 

V) 
H 

0 



5» 

>00 
?: 



2, ft 



c 

12 

< 
n 
J) 



ERIC 



QUESTION 26 



NON-FINISHERS 



H COMPOSITE 



I I 



\ 

\ 



Declared 
Major 



133 



Undeclared 
Major 



0 



MAJOR 
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